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A METHOD AND SYSTEM FOR COLOR TEMPERATURE CONVERSION OF 

COMPRESSED VIDEO IMAGE 



This application claims tlie benefit of Korean Patent Application No. 
10-2002-0038659, filed on July 4, 2002, in the Korean Intellectual Property Office, 
the disclosure of which is incorporated herein in its entirety by reference. 

1 . Field of the Invention 

The present invention relates to a method and system for changing a color 
temperature of a display device, and more particularly, to a method and system for 
estimating a color temperature of a compressed video image and changing the color 
temperature of the compressed video image in accordance with a user's preference. 

2. Description of the Related Art 

The concept of a color temperature refers to the temperature to which a black 
body radiator, such as graphite, has to be heated to produce light of special spectral 
characteristics. In image processing, the color temperature is used to quantify the 
degree of warmness and coldness felt by a user watching a video image. The color 
temperature is indicated in Kelvin degrees, which are equal to 273 degrees plus 
degrees Celsius. The color temperature of a video image is defined as the value at 
which the chromaticity coordinates of the video image match those of a light source. 

In general, a video image having a high color temperature shows an overall 
bluish light, and a video image having a low color temperature shows an overall 
reddish light, different in general from the color temperature preferred by a user. 

As disclosed in U.S. Patent Nos. 4,562,460, 4,633,299, and 4,788,586, in 
order to change a color temperature of a video image according to a user's 
preference, a TV or monitor includes a control button that varies the amount of hue 
or RGB, so that the user can directly adjust the color temperature of a certain video 
image or scene to a desirable color temperature using the control button. 

However, there are many inconveniences when controlling a color 
temperature of a moving video image showing other various contents. In addition, 
methods for changing a color in the above manner make a video image appear less 
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natural as if the video image has passed through a specific color filter. 

As another method for changing a color temperature of a compressed video 
image, U.S. Patent No. 6,172,719 discloses a method for sensing environmental 
brightness and color of a video appliance by using a chromaticity sensing section 

5 and for automatically changing a color temperature of the video appliance. In the 
method, the color temperature of the video appliance is changed based on 
characteristics of environment regardless of the characteristics of a video image 
itself. Thus, the method is appropriate for viewer mood control based on the 
background of a video image, but does not allow for a color temperature change 

10 based on color temperatures of contents of the video image. In general, an 

environment where a video image display device, such as a TV or a monitor, is used 
is not changed frequently. On the other hand, the contents of a video image 
change quite often. Thus, a color temperature of a video image has to be changed 
in accordance with a change in the contents of the video image in consideration of a 

15 user's preference. 

To solve this problem, U.S. Patent Nos. 4,685,071 and 5,495,428 and Korean 
Patent Application No. 1998-531 19 disclose a method for estimating a color 
temperature (illuminant color) of a video image. A method for collectively changing 
a color temperature of a video image to a color temperature preferred by a user, 

20 using a determined color temperature is disclosed in Korean Patent Application No. 
1999-50596. 

However, in all the above methods, a color temperature estimation process is 
performed using a matrix multiplication operation with respect to each pixel. Thus, 
the methods are characterized by considerable computational loads, owing to the 

25 matrix multiplication operation in a user terminal, which lower the quality of an output 
video image and require additional costs for performance improvement. Further, 
when a video image whose color temperature is to be changed is a compressed 
moving video image, the compressed moving video image should be completely 
decoded. This decoding operation adds to the overall computational load, thereby 

30 increasing the response time of devices using these methods. 

SUMMARY OF THE INVENTION 
The present invention provides a method and system for changing a color 
temperature of a compressed video image which, in a case of a video image 
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compressed using block-based discrete cosine transformation (DCT), for example, 
an MPEG compressed moving video image, can reduce the number of pixels to be 
processed during a color temperature estimation process, and improve the 
processing speed of the color temperature estimation process by estimating a color 
5 temperature from a DC video image obtained from DC components of the 

compressed video image, instead of using a video image obtained by completely 
decoding the compressed video image during the color temperature estimation 
process. 

The present invention also provides a method and system for changing a 

10 color temperature of a compressed video image which can improve the overall 
processing speed of a color temperature change process by improving the 
processing speed of the color temperature estimation process. 

According to one aspect of the present invention, a system for estimating a 
color temperature of a compressed video image and changing the color temperature 

15 of the compressed video image includes a color temperature estimation unit, which 
receives a video image compressed using block-based discrete cosine 
transformation, generates a DC video image corresponding to the compressed video 
image, and estimates a color temperature of the compressed video image using the 
DC video image; a decoder, which decodes the compressed video image to 

20 generate an original video image; and a color temperature change unit, which 

determines the estimated color temperature of the compressed video image or a 
color temperature of the decoded original video image as an application color 
temperature depending on whether the compressed video image is a moving video 
image, and changes the color temperature of the decoded original video image in 

25 accordance with the application color temperature and a color temperature preferred 
by a user. 

It is preferable that the color temperature estimation unit includes a DC video 
image extraction section, which extracts DC coefficients of each block from the 
compressed video image, each DC coefficient representing an average value of pixel 
30 values of each block of video image, defines the DC coefficients as each pixel value, 
and generates a DC video image composed of the pixel values; and a color 
temperature estimation section, which estimates a color temperature of the entire 
compressed video image from the color temperature of the DC video image. It is 
also preferable that the color temperature change unit includes an application color 
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temperature determination section, which determines the estimated color 
temperature of the compressed video image or the color temperature of the decoded 
video image as an application color temperature depending on whether the 
compressed video image is a moving video image; and a color temperature change 
5 section, which receives the color temperature preferred by the user and changes the 
color temperature of the decoded video image in accordance with the application 
color temperature and the color temperature preferred by the user. 

According to another aspect of the present invention, a method for estimating 
a color temperature of a compressed video image and changing the color 

10 temperature of the compressed video image includes (a) receiving a video image 
compressed using block-based discrete cosine transformation, generating a DC 
video image corresponding to the compressed video image, and estimating a color 
temperature of the compressed video image using the DC video image; (b) decoding 
the compressed video image to generate an original video image; and (c) 

15 determining the estimated color temperature of the compressed video image or a 
color temperature of the decoded original video image as an application color 
temperature depending on whether the compressed video image is a moving video 
image, and changing the color temperature of the decoded original video image in 
accordance with the application color temperature and a color temperature preferred 

20 by a user. 

It is preferable that step (a) includes (a1 ) extracting DC coefficients of each 
block from the compressed video image, each DC coefficient representing an 
average value of pixel values of each block of the video image, defining the DC 
coefficients as each pixel value, and generating a DC video image composed of the 

25 pixel values; and (a2) estimating a color temperature of the entire compressed video 
image from the color temperature of the DC video image. It is also preferable that 
step (c) includes (c1) determining the estimated color temperature of the 
compressed video image or the color temperature of the decoded original video 
image as an application color temperature depending on whether the compressed 

30 video image is a moving video image; and (c2) receiving the color temperature 

preferred by the user and changing the color temperature of the decoded original 
video image in accordance with the application color temperature and the color 
temperature preferred by the user. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The above and other features and advantages of the present invention will 
become more apparent by describing in detail exemplary embodiments thereof with 
reference to the attached drawings in which: 
5 FIG. 1 is a block diagram illustrating the structure of a system for changing a 

color temperature of a compressed video image, according to the present invention; 

FIG. 2 is a flowchart illustrating a method for estimating a color temperature of 
a compressed video image and changing the color temperature of the compressed 
video image, according to the present invention; 
10 FIG. 3A illustrates a compressed video image and an extracted DC video 

image, according to the present invention; 

FIG. 3B illustrates a method for extracting a DC video image from a 
compressed video image that is interframe-coded, according to the present 
invention; and 

15 FIG. 4 is a flowchart illustrating a method for determining an application color 

temperature of a compressed video image, according to the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 
Hereinafter, the present invention will be described in detail by describing 
20 preferred embodiments of the invention with reference to the accompanying 
drawings. 

FIG. 1 is a block diagram illustrating the structure of a system for changing a 
color temperature of a compressed video image according to the present invention. 
The system for changing a color temperature of a compressed video image 

25 according to the present invention includes a color temperature estimation unit 10 

which estimates a color temperature of an input compressed video image, a decoder 
30 which decodes the input compressed video image, and a color temperature 
change unit 20 which changes a color temperature of the decoded video image in 
accordance with an input color temperature preferred by a user. 

30 In addition, the color temperature estimation unit 10 includes a DC video 

image extraction section 1 1 which extracts a DC video image from the input 
compressed video image and a color temperature estimation section 12 which 
estimates a color temperature of the entire compressed video image from the DC 
video image. 
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In addition, the color temperature change unit 20 includes an application color 
temperature determination section 21 which determines whether the input 
compressed video image is a still video image or a moving video image and 
determines an application color temperature to be used for color temperature change 
5 from the estimated color temperature, and a color temperature change section 22 
which changes a color temperature of the decoded input compressed video image in 
accordance with the application color temperature and the color temperature 
preferred by the user. 

Hereinafter, a method for estimating a color temperature of a compressed 
10 . video image and changing the color temperature of the compressed video image will 
be described with reference to FIGS. 1 and 2. 

FIG. 2 is a flowchart illustrating a method for estimating a color temperature of 
a compressed video image and changing the color temperature of the compressed 
video image, according to the present invention. 
15 As shown in FIG. 1 , the compressed video image is input into the DC video 

image extraction section 1 1 and the decoder 30. The term "compressed video 
image" refers to a still video image or moving video image compressed using 
block-based discrete cosine transformation (DCT), such as an MPEG 1, 2, or 4 
image (S200). 

20 When the input compressed video image is a still video image or an 

internally-coded moving video image, the DC video image extraction section 1 1 
generates a DC video image from the input compressed video image by setting a DC 
coefficient obtained by multiplexing a DCT coefficient with respect to coordinates 
(0,0) of DCT blocks of the input compressed video image by a constant (preferably, 

25 1/8) to one pixel value. The DCT coefficient with respect to coordinates (0,0) of 
DCT blocks represents an average value of pixel values of an original video image 
which corresponds to its DCT block. Thus, an average value of the entire pixel 
values of one DCT block can be obtained using only one coordinate value. 
Accordingly, when the input compressed video image is composed of DCT blocks 

30 each block having N x N pixels, the extracted DC video image has a number of 

pixels equal to 1/N^ times the number of pixels of the decoded video image. This 
will be described in detail with reference to FIG. 3A. 

For brief explanation, assuming that the compressed video image shown on a 
left side of FIG. 3A is composed of 16 DCT blocks, if DCT coefficients with respect to 
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coordinates (0,0) of each of 16 DCT blocks are multiplied by a predetermined 
constant and mapped to one DC video image, a video image shown on the right side 
of FIG. 3A is extracted as one DC video image having a 4 x 4 size, that is, 16 pixel 
values. Consequently, a color temperature of the entire video image can be 
5 estimated from a reduced DC video image having a number of pixels equal to 1/N^ 
times the number of pixels of the original video image. 

Only if a corresponding DCT block is internally-coded like in an MPEG 
intraframe, a value corresponding to coordinates (0,0) of each DCT block is taken 
without changes. However, if the corresponding DCT block is interframe-coded, a 
10 value estimated from DCT blocks referred by a DCT block whose DC coefficients of 
a present frame are to be extracted can be taken as a pixel value of a DC video 
image. 

A method for extracting the DC video image from the interframe-coded 
compressed video image will be described with reference to FIG. 3B. 

15 First, assuming that a present frame is coded by referring to a previous frame, 

when a video image corresponding to a DCT block whose DC coefficients are to be 
extracted is exactly coincident with a video image corresponding to one DCT block of 
the previous frame, a DCT coefficient with respect to coordinates (0,0) of a DCT 
block of the previous frame is used without changes. However, when the video 

20 image corresponding to the DCT block whose DC coefficients are to be extracted 
exists over a plurality of DCT blocks of the previous frame, the DC coefficients are 
determined in accordance with the ratio of the area where the video image 
corresponding to the DCT block whose DC coefficients of the present frame are to 
be extracted to the area of previous DCT blocks. In other words, when the video 

25 image corresponding to the DCT block Bret whose DC coefficients of the present 
frame are to be extracted exists over four DCT blocks B1 , B2, B3, and B4 of the 
previous frame, the ratio of the area occupied by DCT blocks in which the present 
frame is referred is expressed as Wj = (the area of Bret n Bj)/(the area of Bj), and DC 
coefficients of Bjare expressed as DCi(i=1, 2, 3, 4), DC coefficients of the DCT block 

4 

30 Bref are expressed as Z)Q^ = ^ jf^. x Z)Q . 

1=1 

The generated DC video image is input into the color temperature estimation 
section 12, and the color temperature estimation section 12 estimates a color 
temperature from the generated DC video image (S220). Since there is no large 
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difference between the input DC video image and a general video image excluding 
that the size of a video image is greatly reduced, color temperature estimation can 
be performed by a general estimating method of color temperature of the generated 
video image. 

5 After the generated DC video image is input into the color temperature 

estimation section 12, highlighted regions are extracted from the input video image. 
Each of the extracted highlighted regions is projected onto chromaticity plane, 
geometric expression parameters on a corresponding shape on the chromaticity 
plane are calculated, and an average value of the input DC video image is calculated. 

10 The average value of the DC video image is multiplied by a predetermined 

coefficient and set to a self-luminous threshold value, a self-luminous region having 
a chromaticity coordinate value exceeding the self-luminous threshold value is 
removed from the DC video image, and an illuminant color using a recognition light 
source method is estimated from the average value of the DC video image from 

15 which the self-luminous region is removed. A predetermined number of geometric 
expression parameters located around the estimated illuminant color are selected, 
and a final color temperature is estimated using the selected geometric expression 
parameters. 

After the color temperature estimated from the DC video image is input into 
20 the adaptive color temperature change unit 20, the application color temperature 
determination section 21 determines whether the estimated color temperature is 
used for color temperature change of the compressed video image. The decoder 
30 decodes a corresponding frame of the compressed video image (S230). 

A method for determining an application color temperature of the compressed 
25 video image will be described in detail with reference to FIG. 4. 

The application color temperature determination section 21 receives a 
compressed video image from the decoder 30 and determines whether the 
compressed video image whose color temperature is to be changed is a moving 
video image (S231 ). When the compressed video image is a single still video 
30 image, the application color temperature determination section 21 determines an 
estimated color temperature of the input DC video image as an application color 
temperature (S232). 

Meanwhile, when the compressed video image is a moving video image, a 
difference between an estimated color temperature TDc(k) of the DC video image of 
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a present video image frame (k-th frame) and an estimated color temperature 
TDc(k-1 ) of the DC video image of a previous frame is calculated, and the difference 
is compared with a first critical value k1 (S234). 

Since similar scenes are continuously displayed in each frame of a moving 
5 video image, a color temperature having similar values each other with respect to 
each frame of a video image should be maintained although there is a little 
difference therebetween. Thus, a color temperature difference which does not 
make the user feel uncomfortable when watching a video image is set to a first 
critical value k1 (200° K in a preferred embodiment of the present invention). If the 

10 difference between the estimated color temperature TDc(k) of the DC video image of 
the present video image frame and the estimated color temperature TDc(k-1 ) of the 
DC video image of the previous frame is smaller than the first critical value k1 , an 
application color temperature value Tk of the present frame is calculated by adding a 
predetermined correction function value to an application color temperature value 

1 5 T(k-1 ) of the previous frame (S235). 

A difference between color temperature values which is compared with a 
critical value is obtained using a color temperature difference measure function D(t1, 
t2). D(t1 ,t2) is a color temperature difference measure function that determines a 
difference between two color temperatures t1 and t2. After color temperature 

20 regions are changed using a reverse scale, such as 10^/T, D(t1 ,t2) can be defined by 
a difference therebetween. Accordingly, according to an embodiment of the present 
invention, D(t1,t2) is defined as D(t1 ,t2)= |10^/t1-10®/t2| and can be defined by a 
difference between quantized sections after change regions are quantized after 
reverse scale change. 

25 The reason a color temperature difference is defined through reverse scaling 

is that, even though a difference between two color temperatures t1 and t2 in one of 
a high color temperature region and in a low color temperature region is the same, a 
user's feeling of this difference is not the same. In other words, even though the 
difference between two color temperatures t1 and t2 is, for example, 200''K, the user 

30 feels the color temperature difference between video images having a color 

temperature of 800*'K and 1000''K, respectively, much stronger than in the case of 
the color temperature difference between video images having a color temperature 
of ISOO^K and 2000''K, respectively. 
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As such, the color temperature measure function is used as described above, 
instead of using |TDc(l<)-TDc(k-1 )| as a color temperature difference. Besides, 
D(t1 ,t2) can be defined through other scalings, such as linear scaling, nonlinear 
scaling, continuous scaling, or noncontinuous scaling. 

5 As described above, if the difference between the estimated color 

temperature TDc(k) of the DC video image of the present frame and the estimated 
color temperature TDc(k-1) of the DC video image of the previous frame is not larger 
than the first critical value k1 , the application color temperature value T(k) of the 
present frame is calculated by adding a predetermined correction function value to 

10 the application color temperature value T(k-1 ) of the previous frame. When the 

predetermined correction function is g(ti,t2,t3), the application color temperature T(k) 
of the present frame is determined as shown in Equation 1 . 



T(k)=T(k-1)+g(TDc(k),TDc(k-1).T(k-1)) ... (1) 

15 

Here, the correction function g(ti,t2,t3) varies depending on color temperatures 
ti, t2, and ts, and a color temperature difference measure function and can be simply 
defined as g(ti,t2,t3)=ti-t2 (S235). 

Meanwhile, if the difference between the estimated color temperature TDc(k) 

20 of the DC video image of the present frame and the estimated color temperature 
TDc(k-1 ) of the DC video image of the previous frame is larger than the first critical 
value k1, a decoded original video image of the present frame is received from the 
decoder 30 and output to the color temperature estimation section 12 of the color 
temperature estimation unit 10 or to a separate color temperature estimation section 

25 40 or to the color temperature estimation section 40 of the adaptive color 

temperature change unit 20. The color temperature estimation section 12 or 40 
which receives the decoded original video image of the present frame, estimates a 
color temperature of the decoded original video image using the same method as the 
method used to estimate a color temperature from the above-mentioned DC video 

30 image and outputs an estimated color temperature To(k) of the decoded original 
video image to the application color temperature determination section 21 (S236). 

The application color temperature determination section 21 obtains a color 
temperature difference D(TDc(k),To(k)) by applying the estimated color temperature 
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To(k) of the received decoded video image and the estimated color temperature Tdc 
of the DC video image of the present frame to the color temperature difference 
measure function. Thereafter, the application color temperature determination 
section 21 compares the color temperature difference D(TDc(k),To(k)) with a second 
5 critical value k2 (200''K in a preferred embodiment of the present invention) set to a 
color temperature difference that does not make the user feel uncomfortable when 
watching a video image (S237). 

As a comparison result, if the color temperature difference is not larger than 
the second critical value k2, there is a difference of more than the first critical value 

10 k1 between the color temperature estimated from the DC video image of the present 
frame and the estimated color temperature of the DC video image of the previous 
frame. However, since there is no large difference in how the user perceives the 
video image in comparison with a color temperature of the original video image, the 
estimated color temperature TDc(k) of the DC video image of the present frame is 

15 determined as the application color temperature T(k) of the present frame (S238). 

Meanwhile, if the color temperature difference is larger than the second 
critical value k2, since a difference between the color temperature estimated from 
the DC video image of the present frame and the estimated color temperature of the 
DC video image of the previous frame is unacceptable, the application color 

20 temperature T(k) of the present frame is determined as the estimated color 
temperature To(k) of the decoded video image (S239). 

If the present frame is a first frame of a moving video image or a frame whose 
estimated color temperature of the DC video image of the previous frame cannot be 
known owing to network or system conditions, an application color temperature is 

25 determined by performing process S236. 

The application color temperature determined by the application color 
temperature determination section 21 is input into the color temperature change 
section 22, and a color temperature preferred by the user is input into the color 
temperature change section 22 (S240). The color temperature preferred by the user 

30 may be input using a terminal, or selected by the user after a video image display 

device presents a video image of a variety of colors, or be determined in accordance 
with a past color temperature preference value that has been selected by the user on 
an existing video image. 
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The color temperature change section 22 into which the application color 
temperature and the color temperature preferred by the user are input, performs 
color temperature change from the application color temperature into the color 
temperature preferred by the user on the decoded and input original video image of 
5 each frame (S250). 

A method for changing a color temperature of a compressed video image to 
which the present invention can be applied is as follows. A color temperature used 
in a general TV or monitor is set to a reference color temperature. When a color 
temperature preferred by a user is input, the reference color temperature is changed 

10 into the color temperature preferred by the user. When the change is performed 
using a predetermined mapping method, a target color temperature Tt of an output 
video image in which an application color temperature Tj of each frame is changed in 
accordance with the mapping method is obtained, the target color temperature Tt 
and the application color temperature are changed into CIE XYZ tristimulus vectors, 

15 and a conversion matrix M between the two changed tristimulus vectors is obtained. 
A RGB value (Ri,Gi,Bi) of each pixel of an input video image frame is changed into 
linear RGB, changed into CIE XYZ vectors, and the conversion matrix M is applied to 
the changed CIE XYZ vectors. CIE XYZ vectors obtained by applying the 
conversion matrix M are changed into linear RGB, an the linear RGB is changed into 

20 its original RGB, so that a video image whose color temperature is changed is 
output. 

The present invention can also be embodied as a computer readable code on 
a computer readable recording media. The computer readable recording media 
include all types of recording devices in which data that can be read by a computer 
25 system are stored, such as ROMs, RAMs. CD-ROMs, magnetic tapes, floppy discs, 
optical data storage units, and carrier waves (for example, transmission via the 
Internet). Also, the computer readable recording media are distributed over a 
network-connected computer system and can be stored and executed by computer 
readable codes. 

30 In particular, in preferred embodiments of the present invention, the color 

temperature preferred by the user is input into the color temperature change section 
22 after the application color temperature is determined. However, it is obvious to 
those skilled in the art that the objects of the present invention can be achieved even 
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though the application color temperature is determined after the color temperature 
preferred by the user is input into the color temperature change section 22. 

As described above, in a method and system for changing a color temperate 
of a compressed video image according to the present invention, by estimating the 
5 color temperature from a DC video image obtained from DC components of the 
compressed video image, instead of using a video image obtained by completely 
decoding the compressed video image, and omitting a process of completely 
decoding the compressed video image, the number of pixels used during the color 
temperature estimation process is greatly reduced, and the processing speed of the 

10 color temperature estimation process and the overall processing speed of a color 
temperature change process are improved. In addition, by using an adaptive 
method when color temperature change is performed using a color temperature 
estimated from the DC video image, an error in the color temperature change 
caused by a difference between the color temperature estimated from the DC video 

15 image and the color temperature estimated from the original video image is reduced. 
The method and system for changing the color temperature of the 
compressed video image according to the present invention can be used in all 
industrial fields where a variety of digital video image contents are stored in, 
transmitted to, and reproduced in the user terminal. 

20 While this invention has been particularly shown and described with reference 

to preferred embodiments thereof, it will be understood by those skilled in the art that 
various changes in form and details may be made therein without departing from the 
spirit and scope of the invention as defined by the appended claims. 



